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Abstract 

Stretched exponential probability density functions (pdf), having the form of 
the exponential of minus a fractional power of the argument, are commonly found 
in turbulence and other areas. They can arise because of an underlying random 
multiplicative process. For this, a theory of extreme deviations is developed, devoted 
to the far tail of the pdf of the sum X of a finite number n of independent random 
variables with a common pdf e~^ x K The function f(x) is chosen (i) such that the 
pdf is normalized and (ii) with a strong convexity condition that f"(x) > and that 
x 2 f"(x) — > +oo for |x| —* oo. Additional technical conditions ensure the control of the 
variations of f"(x). The tail behavior of the sum comes then mostly from individual 
variables in the sum all close to X/n and the tail of the pdf is ~ e _n /W n ) . This 
theory is then applied to products of independent random variables, such that their 
logarithms are in the above class, yielding usually stretched exponential tails. 

An application to fragmentation is developed and compared to data from fault 
gouges. The pdf by mass is obtained as a weighted superposition of stretched expo- 
nentials, reflecting the coexistence of different fragmentation generations. For sizes 
near and above the peak size, the pdf is approximately log-normal, while it is a power 
law for the smaller fragments, with an exponent which is a decreasing function of 
the peak fragment size. The anomalous relaxation of glasses can also be rationalized 
using our result together with a simple multiplicative model of local atom configu- 
rations. Finally, we indicate the possible relevance to the distribution of small-scale 
velocity increments in turbulent flow. 

PACS : 02.50.+S : Probability theory, stochastic processes and statistics 
89. 90. +n : Other areas of general interest to physicists 



1 Introduction 



Consider the sum 

n 

S n = %i i ( 1 ) 

i=l 

where the X{ are independent identically distributed (iid) random variables with probability 
density function (pdf) p(x) and mean value (x). The central limit theorem ensures, with 
suitable conditions such as the existence of finite second-order moments or refinements 
thereof |l], [|, that as n — > oo the pdf of Sn ~J^ x ' > becomes Gaussian. In other words, the 
"typical" fluctuations of S n f n around its mean value are Gaussian and 0(1/ \/n). The large 
deviations theory is concerned with events of much lower probability when S n /n deviates 
from its mean value by a quantity 0(1) 0, [|, §]. In non-technical terms, for large n, 



Prob 



— - V 
n 



~ e ns{y \ (2) 



where s(y) < is the Cramer function (also called "rate function"). 

In this paper we are concerned with "extreme deviations" , that is the regime of finite n 
and large S n = X. This regime exists only when the pdf extends to arbitrary large values of 
x (i.e. has noncompact support). In other words, we are interested in tail behavior. While 
it is common in statistics to consider test probabilities of the order of 1%, much smaller 
probabilities are of interest in many areas in which crisis may ensue. If, for instance, one 
wishes to investigate whether a chemical substance causes cancer, one will be interested in 
very small test probabilities to make a convincing case. In the field of reliability, failure and 
rupture, for instance of industrial plants, very small probabilities are the rule. Examples 
are the calculation of the probability of a defect item passing an inspection system and the 
calculation of the reliability of a system. 10~ 6 is the probability threshold beyond which the 
U.S. Food & Drug administration considers that any risk from a food additive is considered 
too small to be of concern. In the same spirit, the legal U.S. maximum man-made risk to 
public is 5 x 1CT 5 . 

The main result about extreme deviations for sums of random variables is presented 
in Section ^. The relation to large deviations theory and to other work on extreme devia- 
tions is briefly discussed in Section |3|. Multiplication of random variables is considered in 
Section |. Applications are presented in Section [|. The Appendix is devoted to a rigorous 
derivation of the main result for sums of independent variables. 
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2 Extreme deviations for sums of random variables 



We are interested in the tail behavior for large arguments x of sums of iid random variables 
Xi, i = 1,2,.... We shall only consider large positive values of x. All the results can 
be adapted mutatis mutandis to large negative values. We assume that the common 
probability distribution of the x^'s has a pdf, denoted p(x), which is normalized: 

p(x) dx = 1, (3) 

and which can be represented as an exponential : 

p( x ) = e -/(*) > (4) 

where f(x) is indefinitely different iable.Q We rule out the case where f(x) becomes infinite 
at finite x; this would correspond to a distribution with compact support which has no 
extreme deviations. 

The key assumptions are now listed. All statements involving a limit are understood 
to be for x — > +oo. 

(i) f(x) — > +oo sufficiently fast to ensure the normalization (|3]). 

(ii) f"(x) > (convexity), where /" is the second derivative of / .[] 

(iii) lim fl = 0, for k > 3, where is the kth derivative of /. The k = 3 instance 

[j \ x )) 

of (iii) will be denoted by (iii). 

An important consequence of (iii) is 

\imx 2 f"(x) = +oo, (5) 

the proof of which is given in the Appendix (Lemma 1). 

We introduce now the pdf P n (x) of S n = Ya_ Xi which may be written as a multiple 
convolution : 

P n (x)= J ■■■ J e -^=i f{x * } 5 (x-J^Xij d Xl ---dx n . (6) 



*As we shall see in the Appendix, this assumption can be relaxed. 

^This is called log-concavity of the density by Jensen JtJ whose work we shall comment on in Section ^. 
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All integrals are from — oo to +00. The delta function expresses the constraint on the sum. 

We shall show that, under assumptions (i)-(iii), the leading-order expansion of P n {x) 
for large x and finite n > 1 is given by 



n-l 
2 



P n (x) ~ e - n fW n )-L I 2?r ) , f or x ^oo and n finite. (7) 



\ f"{x/n) 

Furthermore, we shall show that the leading contribution comes from individual terms in 
the sum which are democratically localized. By this we understand that the conditional 
probability of the Xj's, given that the sum is x, is localized, for large x, near 

x 



(8) 

n 



In this section we give a derivation of this result using a formal asymptotic expansion 
closely related to Laplace's method for the asymptotic evaluation of certain integrals ||.[J] 
In the Appendix we shall give a rigorous proof. 

To evaluate (§) for n > 2, we define new variables 

x 

hi = Xi , for i = 1, . . . , n — 1 (9) 

n 

h n = - (h t + . . . + /i n _i) , (10) 



and the function 



g n (x;hi,...,h n - 1 )=J2f[- + hi )- ( n ) 

i=i 

We can then rewrite (M) as 



P n {x) =/■■■/ e-^^^'-^-O dh--- dhn-L (12) 



n-l 



The function g n has the following Taylor expansion in powers of the h^s: 

+M^ 2+ M3I>< + --'' (l3) 

Note the absence of the term linear in the h^s since, by (0), Y%=i hi = 0. 

■^This method is sometimes referred to as "steepest descent", an inadequate terminology when f(x) is 
not analytic. 
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If we momentarily ignore the terms of order higher than two in (|13l) , we obtain for 
P n (x) a Gaussian integral the convergence of which is ensured by the convexity condition 
(ii). This integral is evaluated by setting y = and A = (1/2) f" (x/n) in the identity^ 

J--- J e -A[^+..^ 1+ (^fcx--*n-i) a ] dhl . . . dhn _ x = _L Q 2 e -^ 2 . (14) 

We thereby obtain the desired asymptotic expression (^) for P n (x). 

We now show that higher than second order terms in the taylor expansion ([13]) do not 
contribute to the leading-order result. The quadratic form (1/2)/" (x/n) Yh=i hf in the 
n — 1 variables hi, ... , h n -i can be diagonalized (it is just proportional to the square of 
the Euclidian norm in the subspace Y%=i hi = 0). One can show by recurrence that it has 
n — 2 eigenvalues equal to (1/2) f" (x/n) and one eigenvalue n times larger. Hence, the 



Gaussian multiple integral comes from h^s which are all O i 1/y f"(x/n)j or smaller. For 
such hi's, it follows from the assumption (iii) that all higher order terms are negligible for 
large x. Furthermore, the scatter of the Xj's around the value x/n, measured by the the 
rms value of the h^s is O {l/ \J f"(x/n)^j . By (||), this is small compared to x, which proves 
the democratic localization property (||). 

We shall also make use of a weaker result obtained by taking the logarithm of (0), 
namely 

lnP n (x) ~ — nf(x/n), for x — ► oo and n finite. (15) 
This weaker form holds only if 

^WnT <16) 
We make a few remarks. Our derivation is reminiscent of the derivation of Laplace's 

asymptotic formula for integrals of the form / e~ x ^ x ^ dx when A — > oo, as given, e.g., in 

Ref. |§. The main difference is that in Laplace's method, when / is Taylor expanded 

around its minimum, terms of order higher than two give contribution smaller by higher 

and higher inverse powers of A, so that a single small parameter 1/A is enough to justify 

the expansion, whereas here we made an infinite number of assumptions (iii) for all n > 3. 

Actually, it will be shown in the Appendix that the sole assumption (iii) with a slight 

strengthening of (H) is enough to derive the leading-order term (|7|). 

§This identity if obtained, after proper normalization, by evaluating the n-fold convolution of a Gaussian 
distribution of variance with itself, which is a Gaussian of variance 53- . 



It is easily checked that our result is not equivalent to the well-known fact that the 
most probable increment ^ of a random walk conditionned to go from (x,t) to (x',t') is 
constant and equal to the average slope j i n other words, the most probable path is 
then a straight line, corresponding to a constant reduced running sum. 

The convexity of f(x) at large x is essential for our result to hold. For instance, pdf's 
with powerlaw tails p(x) oc x~^ 1+ ^ give f(x) = (1 + p) Inx which is concave. The extreme 
deviations of the sum S n are then controlled by realizations where just one term in the sum 
dominates. This extends to arbitrary exponents /i, in this extreme deviations regime, the 
well-known result that the breakdown of the central limit theorem for 11 < 2 stems from 
the dominance of a few large terms in the sum. The breakdown of democratic localization 
far in the tail also happens for pdf's with finite moments of all orders, for example, when 
p(x) oc x~ lnx at large x. Here, again the function f(x) = In 2 x is not convex. 

The result flT5|) can be formally^ generalized to the case of dependent vari- 
ables with nonseparable pdf's p(xi, X2, Xi, x n ) = exp[— f(xi,X2, ■■■,Xi, ...,x n )] where 
f(xi, x 2 , Xi, x n ) is symmetric and convex. Indeed, §£-\ Xl=X2= =Xn= Sn, is then indepen- 
dent of i and the matrix of second derivatives evaluated at x\ = X2 = ■■ = x n = ^ is 
positive, ensuring that / is minimum at Xi = x 2 = ■■ = x n = thereby providing the 



major contribution to the convolution integral. 

3 Relation with the theory of large deviations 

We now assume, in addition to conditions (i)-(iii) of Section ||, that the characteristic 
function 

00 

Z{fi) = {e~ Px ) = f e~ px p{x) dx (17) 



-oo 



exists for all real /3's (Cramer condition). Recall that the Cramer function s(y) is deter- 
mined by the following set of equations (see, e.g., Refs. [|], || (|) : 

s(y) = In Z(P) + Py, (18) 
ds(y) 



dy 



(3. (19) 



^Additional assumptions are then needed to make sure that higher than second-order terms in the 
Taylor expansion are not contributing. 
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Hence, s(y) is the Legendre transform of \nZ(/3). 

Comparison of @ with (p~5|) shows that the Cramer function s(y) becomes equal to 
—f(y) for large y. We can verify this statement by inserting the form p{x) = e~^ x ' into 
fll7|) to get Z(/?) ~ /f^ dxe~^ x ~^ x \ For large |/3|, we can then approximate this integral 
by Laplace's method, yielding Z((3) ~ e - min o:(/3a;+/(^))_ Taking the logarithm and a Leg- 
endre transform, we recover the identification that s(y) — > —f(y) for large Laplace's 
method is justified by the fact that \y\ — > oo corresponds, in the Legendre transformation, 
to |/?| — ► oo. A number of more precise results are known, which relate the tail proba- 
bilities of random variables to the large-?/ behavior of the Cramer function. For example, 



Broniatowski and Fuchs |H| give conditions for the asymptotic equivalence of s(y) (called 
by them the "Chernov function") and of — In F(y) where F(y) = p(x) dx. 

A consequence is that the large and extreme deviations regime overlap when taking the 
two limits n — > oo and ^ — > oo. Indeed, large deviations theory usually takes n — > oo 
while keeping finite, whereas our extreme deviations theory takes n finite with S n — > oo. 
Our analysis shows that, in the latter regime, Cramer's result already holds for finite n. 
The true small parameter of the large deviations theory is thus not i but min(^, J*-). 



A paper by Borokov and Mogulskii |TI[ contains a result resembling somewhat ours. 



Their eq. (12) of Section 1 states, in our notation, that 

s n (y) =ns(y/n), (20) 

where s n (y) is the Cramer function for the sum of n independent and identically distributed 
copies of a random variable with Cramer function s(y). If we identify the tail of the Cramer 
function with minus the logarithm of the (tail of the) pdf, their result becomes identical 



with (15). However, their result makes no use of the convexity assumption without which 



our result will generally not hold. 



Broniatowski and Fuchs |1(| derive a more general but weaker theorem on the cumula- 
tive distribution of S n for finite n, which ressembles somewhat our result on the democratic 
localization property @. It is more general because it is valid for pdf's not obeying the 
convexity condition ([D, for example, the Cauchy distribution. It is weaker because it states 
only that there is a number a n > such that 



InProb (S n > nx) = a n [l + o(l)] InProb (min(xi, . . . , x n )) > x) 



(21) 
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for x — > oo. Roughly speaking, (|2lD means that the main contributions to the event 
S n > nx come from the realizations where all variables constituting the sum are larger 
than x, a much weaker statement than the property of democratic localization (§). 

Jensen |7j also considers the case where n is finite and the tail probability tends to zero, 
for particular choices of the pdf. Jensen is able to show in a few examples that, even though 
there is no asymptotics, i.e. there is no n tending to infinity, the saddlepoint expansion 
allows one to get the correct order of the probabilities in the tail, using the so-called tilted 
density introduced by Esscher [12|. Coupled with the Edgeworth expansion, this leads 



to results similar to ours. Our work generalizes and systematizes these partial results by 
providing general conditions of applications, in particular not requiring that / be Taylor 
expandable to all orders (see the Appendix). 

4 Multiplications of random variables 

Consider the product 

X n = mim 2 ....m n (22) 

of n independent identically distributed positive^ random variables with pdf p(x). Taking 
the logarithm of X n , it is clear that we recover the previous problem (HD with the corre- 
spondence Xi = hxrrii, S n = lnX n and —f(x) = \np(e x ) + x. Assuming again the set of 



conditions (i), (ii) and (iii) on /, we can apply the extreme deviations result (|1^) which 
translates into the following form for the pdf P n (X) of X n at large X : 

P n (X) ~ [p(X^)} n , for X -> oo and n finite. (23) 

[In this section we omit prefactors; this amounts to using (|15D instead of (0).] Equation 
(|23[) has a very intuitive interpretation: the tail of P n (X) is controlled by the realizations 
where all terms in the product are of the same order; therefore P n (X) is, to leading order, 
just the product of the n pdf 's, each of their arguments being equal to the common value 

X n . 

When p(x) is an exponential, a Gaussian or, more generally, of the form oc exp(— Cx 1 ) 
with 7 > 0, then (|23|) leads to stretched exponentials for large n. For example, when 
p(x) oz exp(— Cx 2 ), then P n (X) has a tail oc exp(— CnX 2 / n ). 

"What follows is immediately extended to the case of signed mi's with a symmetric distribution. 
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Note that ( p23|) can be obtained directly by recurrence. Starting from X n+ i = X n x n+ i, 
we write the equation for the pdf of X n+1 in terms of the pdf 's of x n+ i and X n : 



/•oo roo 

P n +i(X n+ i) = / dX n P n (X n ) i dx n+ ip{x n+ i)5{X Tl+ i — X r 
Jo Jo 



00 dX n „ ,„ x fX n+l 



X n 



(24) 



The maximum of the integrand occurs for X n = (X n+ i)~^~ at which Xn = A ^- +1 . Assuming 
that P n (X n ) is of the form (|2"B|), the formal application of Laplace's method to ( PH ) then 
directly gives that P n+ i(X n+ i) is of the same form.0 Thus, the property (p3|) holds for all 
n to leading order in X. 

Some generalizations are easily obtained. For instance, for exponential distributions, 
we can allow for different characteristic scales otj defined by Pj(x) = c^e -0 ^- 7 '. Eq. ( p3|) 
then becomes 



x 



P n {X) ~ exp( -n 



a, 



n -| 

for X n >n-- 



(25) 



Similarly, if Pj(x) = e 2ct j , with Xj > 0, we obtain 



P n (X) ~ exp 



n 



X 2 



i=l a i 



for X n > CTj. 
i=i 



(26) 



5 Applications 



Considering the simplicity and robustness of the results derived above, we expect the ex- 
treme deviation mechanism to be at work in a number of physical or other systems. We 
are thinking in particular of the application of our result to simple multiplicative processes, 
that might constitute zeroth-order descriptions of a large variety of physical systems, exhib- 
ing anomalous pdf and relaxation behaviors. There is no generally accepted mechanism for 
their existence and their origin is still the subject of intense investigation. The extreme de- 
viations regime may provide a very general and essentially model-independent mechanism, 
based on the extreme deviations of product of random variables. 



"Control over higher-order terms in the asymptotic expansion requires, of course, the same conditions 
(i)-(iii) as in Section 0. 
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Fragments are often found to be distributed according to power law distributions |13| : 



In Section |5.1| , we propose a multiplicative fragmentation model in which the exponent 
is controlled by the depth of the cascading process. Anomalous relaxations in glasses 
have been largely documented to occur according to stretched exponentials |14|, |15 . In 



Section |5.2| , we construct a relaxation model based on the idea that a complex disordered 
system can be divided into an ensemble of local configurations, each of them hierarchically 
ordered. Stretched exponential pdf are observed in turbulent flow (see, e.g., Ref. ||) 
and our extreme deviation theory provides a simple scenario (Section |5.3|) . Let us finally 
mention the question of stock market prices and their distribution. Here, the very nature 



of the pdf's is still debated [16|, [17]]. While price variations at short time scales (minutes 



to hours)are well-fitted by truncated Levy laws [[18], other alternative have been proposed 
||16|| . We have found that a stretched exponential pdf provides an economical and accurate 
fit to the full range of currency price variations at the daily intermediate time scale. We 
will come back in future work to document this claim and to describe the relevance of the 
multiplicative processes studied here. 

5.1 Fragmentation 

Fragmentation occurs in a wide variety of physical phenomena from geophysics, material 

sciences to astrophysics and in a wide range of scales. The simplest (naive) model is 

to ignore conservation of mass and to view fragmentation as a multiplicative process in 

which the sizes of children are fractions of the size of their parents. If we assume that 

the succession of breaking events are independent and concentrate on a given generation 

rank n, our above result fl2B|) applies to the distribution of fragment size X, provided we 

take X to zero rather than to infinity. Indeed, the factors m 1) m 2 , ■■■,m n are all less or 

equal to unity.Q If we take, for example, p(m) oc exp (—cm a ) for small m, we obtain 

P n (X) oc exp ^-oiI"/"J. For values of X which are order unity, large deviations theory 

applies when n — > oc. This does not, in general, lead to a log-normal distribution, because 

central limit arguments are inapplicable, except in the very neighborhood of the peak of 

the pdf of X (see, e.g., Ref. 0, Section 8.6.5). 

Next, we observe that most of the measured size distribution of fragments, not con- 

When taking the logarithm, the tail for X — > corresponds to the regime where the sum of logarithms 
goes to — oo. Although X — > 0, is not strictly speaking a "tail", we shall still keep this terminology. 
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ditioned by generation rank, display actually power-law behavior oc X T with exponents 



r between 1.9 and 2.6 clustering around 2.4 [19|. Several models have been proposed to 



rationalize these observations JT3|, but there is no accepted theoretical description. 

Here, we would like to point out a very simple and robust scenario to rationalize these 
observations. We again neglect the constraint that the total mass of the children is equal 
to that of the parent and use the simple multiplicative model. Indeed, the constraint 
of conservation becomes less and less important for the determination of the pdf as the 
generation rank increases. To illustrate what we have in mind, consider a comminution 
process in which, with a certain probablity less than unity, a "hammer" repetitively strikes 
all fragments simultaneously. Then the generation rank corresponds to the number of 
hammer hits. In real experiments, however, each fragment has suffered a specific number 
of effective hits which may vary greatly from one fragment to the other. The measurements 
of the size distribution should thus correspond to a superposition of pdf 's of the form ( PB"D 
in the tail X — > 0. Recent numerical simulations of lattice models with disorder |2l| show 
indeed that, for sufficient disorder, the fragmentation can be seen as a cascade branching 
process. 

Let us now assume that the tail of the size distribution for a fixed generation rank n is 
given by (|23|) and that the mean number N(n) (per unit volume) of fragments of generation 
rank n grows exponentially: N(n) oc e Xn with A > 0. It then follows that the tail of the 
unconditioned size distribution is given by 

P&*(X) ~ £ \p(Xn)} V n ~ / dne nl ^ x ^ +nX . (27) 

Application of Laplace's method in the variable n, treated as continuous, gives a critical 
(saddle) point 

n* = --lnX, (28) 
a 

where a is the solution of the transcendental equation 

A + lnp(e- a ) + ae~ a P f- = 0. (29) 
The leading-order tail behavior of the size distribution is thus given by 



P size (X) ~ X~\ (30) 
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with an exponent 



a 



lnp(e- Q ) + A . (31) 



This solution ( ffOp holds for A smaller than a threshold A c dependent on the specific structure 
of the pdf p(x). For instance, consider p(x) oc exp (-CV 5 ) for x -> 0, with 5 > 0. This 
corresponds to a pdf going to a constant as x — > 0, with a vanishing slope (5 > 1), infinite 



-aS 



slope (5 < 1) or finite slope (5 = 1). The equation (p9|) for a becomes ^ = (1 + a<5)e" 
This has a solution only for A < C, as the function (1 + x)e~ x has its maximum equal to 
1 at x = 0. For A approaching C from below, the exponent of the power law distribution 
is given by r = C5 + 0(\/C — A). At the other end A — > + , we get r — > C5e. In between, 
for < A < C, the quantity ^ goes continuously from e ~ 2.718 to 1. It is interesting 
that t depends on the parameters of the pdf p(x) only through the product CS. 

What happens for A > C ? To find out, we return to the expression ( p7|) giving the tail 
of the unconditioned size distribution and find that the exponential in the integral reads 
e n(A-ci*/")^ j n }j m j^ G f sma n fragments X — > 0, the term X s ^ n is dominated by the 
large n limit for which it is bounded by 1. Thus, A — CX & l n < A — C . For A > C, the larger 
n is, the larger the exponential is, while for A < C there is an optimal generation number 
n+, for a given size X, given by (|28D . For A > C, the critical value n+ moves to infinity. 
Physically, this is the signature of a shattering transition occurring at A = C : for A > C, 
the number of fragments increases so fast with the generation number n (as e Xn > e Cn ) 
that the distribution of fragment sizes develops a finite measure at X = 0. This result is 
in accordance with intuition : it is when the number of new fragments generated at each 
hammer hit is sufficiently large that a dust phase can appear. This shattering transition 
has been obtained first in the context of mean field linear rate equations ||22|| . 

Consider another class of pdf p(x) oc exp Cx~ s ^ for x — ► 0, with 5 > 0. The pdf 
p(x) goes to zero faster than any power law as x — ► (i.e. has an essential singularity). 
The difference with the previous case is that, as the multiplicative factor x —>■ occurs 
with very low probability in the present case, we do not expect a large number of small 
fragments to be generated. This should be reflected in a negative value of the exponent r. 
This intuition is confirmed by an explicit calculation showing that r becomes the opposite 
of the value previously calculated, i.e. ^ goes continuously from — e ~ —2.718 to —1 as A 
goes from to C. 
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In sum, we propose that the observed power-law distributions of fragment sizes could be 
the result of the natural mixing occurring in the number of generations of simple multiplica- 
tive processes exhibiting extreme deviations. This power-law structure is very robust with 
respect to the choice of the distribution p(x) of fragmentation ratios, but the exponent r 
is not universal. The proposed theory leads us to urge the making of experiments in which 
one can control the generation rank of each fragment. We then predict that the fragment 
distribution will not be (quasi-) universal anymore buton the contrary characterize better 
the specific mechanism underlying the fragmentation process. 

The result (|30|) only holds in the "tail" of the distribution for very small fragments. 
In the center, the distribution is still approximately log-normal. We can thus expect a 
relationship between the characteristic size or peak fragment size and the tail structure 
of the distribution. It is in fact possible to show that the exponent r given by fl3~T|) is a 
decreasing function of the peak fragment size : the smaller is the peak fragment size, the 
larger will be the exponent (the detailled quantitative dependence is a specific function of 
the initial pdf). This prediction turns out to be verified by the measurements of particle 
size distributions in cataclastic (i.e. crushed and sheared rock resulting in the formation 



of powder) fault gouge |^3[ : the exponent r of the finer fragments from three different 
faults (San Andreas, San Gabriel and Lopez Canyon) in Southern California was observed 
to be correlated with the peak fragment size, with finer gouges tending to have a larger 
exponent. Furthermore, the distributions were found to be a power law for the smaller 
fragments and log-normal by mass for sizes near and above the peak size. 

5.2 Stretched exponential relaxation 

We would like to suggest a possible application of the stretched exponential distribution to 
rationalize stretched exponential relaxations. A priori, we are speaking of a different kind 
of phenomenon : so far we were discussing distributions, while we now consider the time 
dependence of a macroscopic variable relaxing to equilibrium. In contrast to simple liquids 
where the usual Maxwell exponential relaxation occurs, "complex" fluids [p4fl , glasses |14|, 



TR E5|, porous media, semiconductors, etc, have been found to relax with time t as e 



-at? 



with < (3 < 1, a law known under the name Kohlrausch- Williams- Watts law flj], 15 1 



Even, the Omori 1/t law for aftershock relaxation after a great earthquake has recently 
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been challenged and it has been proposed that it be replaced by a stretched exponential 



relaxation |f26] . This ubiquitous phenomenon is still poorly understood, different competing 
mechanisms being proposed. An often visited model is that of relaxation by progressive 



trapping of excitations by random sinks |15j . Models of hierarchically constrained dynamics 
for glassy relaxations [J25| suggest the relevance of multiplicative processes to account for 
the relaxation in these complex, slowly relaxing, strongly interacting materials. Our model 
offers a simple explanation for the difference in f3 measured by the same method on different 
materials in terms of the dependence of (3 on the typical number of levels of the hierarchy 
as we now show. 

We assume that a given system can be viewed as an ensemble of states, each state 
relaxing exponentially with a characteristic time scale. Each state can be viewed locally 
as corresponding to a given configuration of atoms or molecules leading to a local energy 
landscape. As a consequence, the local relaxation dynamics involves a hierarchy of degrees 
of freedom up to a limit determined by the size of the local configuration. In phase space, 
the representative point has to overcome a succession of energy barriers of statistically 
increasing heights as time goes on; this is at the origin of the slowing down of the relaxation 
dynamics. The characteristic time ti to overcome a barrier AEi is given by the Arhenius 
factor ti ~ Toe AEi ^ kT , where k is the Boltzmann constant, T the temperature and tq a 
molecular time scale. For a succession of barriers increments, we get that the characteristic 
time is given by a multiplicative process, where each step corresponds to climbing the next 
level of the hierarchy. In other words, the characteristic relaxation time of a given cluster 
configuration is obtained by a multiplicative process truncated at some upper level. It is 
important to notice that our model is fundamentally different from the idea of diffusion of a 
representative particle in a random potential with potential barriers increasing statistically 
at long times, as in Sinai's anomalous diffusion j37|. We consider rather that the system 
can be divided into an ensemble of local configurations, each of them hierarchically ordered. 

In this simple model, the times T n = To(ti/T )...(t n /r ) are thus log-normally distributed 
in their center with stretched exponential tails according to our extreme deviation theory. 
Now, in a macroscopic measurement, one gets access to the average over the many different 
local modes of relaxation, each with a simple exponential relaxation : an observable O is 
thus relaxing macroscopically as O ~ (e^), where the average of the observable O is 
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carried out over the distribution of T n . For large t (compared to the molecular time scale), 
Laplace's method gives the leading-order behavior 

with (3 = for a distribution of T n given by e - an ( T ^/ T o) n . i n this calculation, we have as- 
sumed that all local configuration clusters are organized hierarchically according to a fixed 
number of n levels. We envision that this organization reflects the local atomic or molecu- 
lar arrangement such that the system can be subdivised into a set of essentially mutually 
independent local configurations. These configurations can tentatively be identified with 
the locally ordered structures observed in randomly packed particles |f28| , macromolecules 
|29| , glasses and spinglasses H30| . The ultrametric structure found to describe the energy 



landscape of the spinglass phase of mean field models also leads to a multiplicative cascade 
|31~| , |32fl . Notice that if a system possesses multiple configuration levels n, then by the same 
mechanism which in fragmentation led to (0), the relaxation becomes a power law instead 
of a stretched exponential. 

The often encountered value (3 ~ 1/2 corresponds, in our model, to the existence of 
n ~ a levels of the hierarchy. It is noteworthy that the factor a can be determined 
quantitatively from the pdf p(tj/r ) ~ exp[— a(tj/r ) a ] of the multiplicative factors, thus 
giving the potential to measure the number of levels of the hierarchy that are visited by the 
dynamical relaxation process. This could be checked for instance in multifragmentation in 
nuclear collisions, utilizing techniques sensitive to the emission order of fragments [[J3|]. 

Hierarchical structures are also encountered in evolutionary processes computing 



architectures |35| and economic structures f36j and, as a consequence, it is an interesting 



question whether to expect dynamical slowing down of the type described above. 
5.3 Turbulence 

In fully developed turbulence, random multiplicative models were introduced by the Rus- 
sian school [BTl BR BP] and have been studied extensively since. Indeed, their fractal and 



multifractal properties provide a possible interpretation for the phenomenon of intermit- 
tency 0, |4l| (see also Ref. ||). The pdf 's of longitudinal and tranverse velocity increments 



clearly reveal a Gaussian-like shape at large separations and increasingly stretched expo- 



nential tail shapes at small separations, as shown in Figure 1 [[42, 43, H, HE 46]. 
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Within the framework of random multiplicative models, our theory suggests a natural 
mechanism for the observed stretched exponential tails at small separations as resulting 
from extreme deviations in a multiplicative cascade. However, this mechanism cannot 
account for all properties of velocity increments. For example, random multiplicative 
models are not consistent with the additivity of increments over adjacent intervals. Indeed, 
the pdf of velocity increments 5v cannot become much larger than the single-point pdf, as 
it would if the former were cx exp (^—C\8v\^J with < (3 < 2 while the latter would be close 
to Gaussian (see the Appendix of Ref. [HI). Nevertheless, stretched exponentials could be 
working in an intermediate asymptotic range of not too large increments, the controlling 
parameter of this intermediate asymptotics being the separation over which the increment 
is measured. 
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Appendix 

A Proof of the main results for extreme deviations 



Our aim is to prove (0) without necessarily assuming that the function f(x), which defines 
the pdf of the individual variables though (|j), is Taylor expandable to all orders. Specifi- 
cally, we assume that / is three times continuously differentiable and satisfies the following 
conditions when x — > +00 : 

(i) f(x) — > +00 sufficiently fast to ensure the normalization (|3]). 

(ii) f"(x) > (convexity), where /" is the second derivative of /. 

(iv) There exists C\ > such that, for x < y large enough, x 2 j"{x)j (y 2 f"(y)) < C\. 

(v) There exist (3 > and C2 > such that x 2 ~@f(x) > C2 for large enough x. 

Assumptions (i) and (ii) are just the same as made in Section |2|. Assumption (iii) is an 
instance of (iii) corresponding to the third derivative. Note that nothing is assumed about 
higher order derivatives. Assumptions (iv) and (v) are new and will be seen to be slight 
strengthenings of a corollary of (iii) . 
We begin by proving various lemmas. 

Lemma 1 Assumption (iii) implies 

\imx 2 f"(x) = +00. (A.l) 
To prove this result, we start from (iii) which may be rewritten as 

lim 4- ; 1 = 0. (A.2) 

™ dx y/f"{x) 

It follows that for any e > there exists X(e) such that, for x > X(e), the argument of the 



limit in (|A.2p is less than e in absolute value. We take X(e) < y < x and apply the mean 
value theorem to get 



(f"(x))- 1/2 - (f (y))- 1/2 ={x-y) 



T f (nor 112 



(A.3) 



« There are weaker formulations of (iv) and (v) for which our results hold, which we do not make explicit 
here, as they are quite involved and do not bring any additional insight. 
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with y < £ < x. The rhs of (|A.3|) is less than (x — y)e. Dividing by x and letting x — > oo, 
we obtain 

limsup — j== < e. (A. 4) 

a; - >00 xJf"(x) 

Letting e -> 0, we obtain flOp. QED 

Lemma 2 Under assumptions (ii), (hi) and (iv), 

\x-y\ = C(f"(x))~ 1/2 (A.5) 

implies, that 

f"(y) 

- — > 1, /or x — » +oo and fixed C. (A. 6) 
/"(x) 

For the proof, let us first assume that y < x. By the mean value theorem, we have 

f"(x)-f' , (y) = (x-y)f" , (Z), withy <£<x. (A.7) 

It follows from Lemma 1 and ( |A.5|) , that x/y — > 1 and thus £/x — > 1 as x — > +oo. Dividing 
( |A.7| ) by /"(x) and using ( |A.5[ ), we obtain 

nx)-ny) _ no mm 3/2 rA8 , 
/" (x) (f(0) 3/2 V/"(^)y ' 

By (iv), the rightmost factor on the rhs is less than Cj 5 (a;/£) 3 , which remains bounded as 
x — > +oo, while, by (hi), the leftmost factor on the rhs tends to zero. Hence, the rhs tends 
to zero. This implies ( |A.(j| ). 

For the case x < y, (|A.7|) holds similarly with x < £ < y. We then multiply (|A.7|) by 
(/"(x)) 1 / 2 /(/"(w)) 3 / 2 . The rhs tends again to zero. If follows that 



f»(x)-f"(y) ff"(x)\ 1/2 



0, (A.9) 



f"(y) \f"(y)J 

which implies again (|A.6| ). QED. 

Lemma 3 Let hi, i = 1, . . . , n be real variables, not all vanishing, such that Yh=i hi = 0. 
The subset of p < n — 1 indices ij such that hi- > satisfies 

thl>~±hl (A. 10) 

j=l a i=l 
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Let ip+i, ■ ■ ■ , i n denote the subset of indices such that hi- < 0. We set h^. — —h%. > 0, 
so that 



v 



E^ = E !>',■ (A-n; 
j=i j=p+i 



We have 



n 



E^ 2 = E^ + E ^ 

i=i 3=1 j=p+i 

n \ 

£ 

j=p+i 

(\ 2 
P \ 
Eh 
3=1 

< fhl+pfhl 
i=i i=i 

< nfX- (A. 12) 

In deriving ( |A.12| ), we have used p < n — 1 and the following inequality for a set of p 
nonnegative variables j/i, . . . , ?/ p 

(yi + --- + y P ) 2 <p(2/i 2 + --- + ^)- (A.13) 



Lemma 3 follows from ( |A .12 ). QED. 



We now turn to the derivation of the main result (0), rewritten here in a slightly different 
form as : 

l im 3^EL=i (A.14) 
P„ as -(x) 

where 

n-l 

P n as -(:r) = e -«/(*/«)_ — JL_ . (A. 15) 

\f"(x/n)J 



We start from the representation fll2|) of the pdf of the sum of n iid variables as an 
(n — l)-fold integral. The function g n , given by flllD can be rewritten as 

g n = nf(x/n) + £ J dz J f"(y) dy. (A.16) 



i=l 



n n 
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Observe that, by (0), we have Y%=i = 0, so that, ignoring contributions of zero measure, 
at least one of the hiS must be positive. Furthermore, all the terms involving double 
integrals are positive. 

The proof goes now as follows. By Lemma 2, the second derivative f"(y) can be replaced 
by the second derivative at the minimizing point x/n as long as all the h^s are not too 
large, that is are in the set Ah defined by 

\fn\ <H = C{f"{x/n))~ l/2 , for all i. (A.17) 



By ( |A.1|) , ( A.17|) expresses that all the individual random terms in the sum stay within a 



distance of x/n which is small compared to x, that is, what we have called the democratic 
localization property. The substitution of f"(x/n) for f"(y) amounts to using the second- 
order truncation of the Taylor series ( Jl3| ) for g n , which leads to P^\x). It follows from 
Lemma 2 that the error committed in this substitution is small for large x. 

Since f"(x) > 0, the contribution of the complementary set Ah to the pdf P n (x), 
denoted P( >H \x), is estimated from above by estimating g n from below, keeping only the 
contributions from the subset ij (j = 1, . . . ,p < n — 1) of indices such that hi- > 0. We 
thus obtain 



p 



9n > nf(x/n) + <T J dzj f"(y) dy. (A.18) 



j = l X 

n n 

By (iv), for x/n < y < x/n + h^, we have 

y 2 f"(y) > C- x \x/nfr\x/n). (A.19) 
Using ( |A.19|) in ( |A.18| ), we obtain 



x N 2 



n 



9n > nf(x/n) + Cr 1 ( - ) f'Xx/n) ^ q(nh t Jx), (A.20) 

3=1 



where 

q(a) = a-ln(l + a). (A.21) 

Note that q(a) = a 2 /2 + 0(a 3 ) for small a and q(a) < a for large a. Assumption (v) 
is used to show that, for large x, the overwhelming contribution to P^ >H \x) comes from 
hi 's such that nhijx is small compared to unity. Using ( |A.2U| ) and Lemma 3, we obtain 
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the following estimate 

Pi >H \x) < e ~ nf{x/n) J ■■■ J e -^r/"(*/ n )Efei fc ? dh x --- dh n _ x , (A.22) 

where the domain of integration is over Ah, so that at least one of the \hi\ > if = 
C(f"(x/n))~ 1 / 2 . As a consequence, it is easily checked that the bounding integral is less 
than P% s '(x) multiplied by a factor O (e~ c2 l n ^j, which tends to zero very quickly for large 
C. This proves QA.14J) and the democratic localization property. 
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FIGURE CAPTIONS 

Figure 1 : pdf of transverse velocity increments reduced by the rms velocity at various 
separations in units of the Kolmogorov dissipation scale r\. (From Ref. [§j| .) 
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